02. Descriptive Statistics
PRDTM2-785 AI Trading C2 L4 Vid2 Descriptive Statistics
Understanding Descriptive Statistics in EDA
Exploratory Data Analysis (EDA) focuses on gaining insights from data, using foundational techniques like descriptive statistics to summarize the data.
What Are Descriptive Statistics?
- Descriptive Statistics: Summarize data features into single numbers.
- Example: Average (mean) of a set of numbers.
Common Descriptive Measures:
Mean:
- Calculate by summing data points and dividing by the total number.
- Note: Can be skewed by extreme values (outliers).
Median:
- Represents the middle value when data is ordered.
- Less affected by outliers, providing a more accurate center.
Variance:
- Measures data spread by averaging squared deviations from the mean.
Standard Deviation:
- Square root of variance, indicating data's average distance from the mean. Useful for assessing risk levels.
Importance in Analysis
- Descriptive stats help summarize and understand current data.
- Not predictive—should be combined with other analytical tools for comprehensive analysis.
Reminder: Descriptive statistics cannot predict future values; include other tools for reliable analysis.
SOLUTION:
- Descriptive statistics provide a summary of data through measures such as mean, median, and standard deviation.
- The median provides a better measure of central tendency than the mean when outliers are present.
- Variance and standard deviation give insights into the spread of the data and are important for assessing risk in contexts like trading.